RSS 2007 Manipulation Workshop: 
Sensing and Adapting to the Real World 

Time & Location. Saturday, June 30th, 2007 in room 1 1 16E and the atrium of 
the Klaus Building, which is building 153 on the Georgia Tech campus. Talks and 
discussions will be held in the auditorium. Posters, demonstrations, and breaks 
will take place in the atrium. 



9:00-9:05 

Tactile 

Sensing 



Welcome from the organizers 



:05-9:30 



Touch Based Perception for Object Manipulation 

Anna Petrovskaya, Oussama Khatib, Sebastian Thrun, and 

Andrew Y. Ng 



An Experiment in the Use of Manipulation Primitives and Tactile 

Perception for Reactive Grasping 

Antonio Morales, Mario Prats, Pedro Sanz, and Angel P. Pobil 

Grasping POMDPs: Theory and Experiments 

Ross Glashan, Kaijen Hsiao, Leslie Pack Kaelbling, and Tomas 

Lozano-Perez 

Poster and demo session #1 

(refreshments from 10:30-10:45) 

1 . Tactile Sensing Arrays for Humanoid Robots 
Ravinder S. Dahiya, Maurizio Valle, Giorgio Metta, and 
Leandro Lorenzelli 

2. Guiding Grasping with Proprioception and Markov Models 
Peter Deckers, Aaron M. Dollar, and Robert D. Howe 

3. A Switching Control Approach to Haptic Exploration for 
Quality Grasps 

Di Wang, Brian T. Watson, and Andrew H. Fagg 

4. Optimal Reaching and Balancing for Humanoid Robots 
Juyong Park, Bokman Lim, Jaeyoung Haan, and F.C. Park 

5. A Framework for Visually Guided Haptic Exploration with 
Five Finger Hands 

A. Bierbaum, K. Weike, D. Burger, T. Asfour, and R. 
Dillmann 

6. Learning Sequences of Contact-relative Motions for 
Grasping 

Robert Piatt 



Discussion on tactile sensing 
Topics may include: 

How much can be achieved with tactile sensing, and what are 
its limits? 

2. How can tactile sensing best be integrated with control? 

3. What are the main challenges in tactile sensing for 





manipulation? 

4. What are the advantages and disadvantages with respect to 
other forms of sensing? 

5. For what real-world applications is this modality best suited? 


Low- 
dimensional 
Control 




11:30-11:55 


2D Subspaces for User-Driven Robot Grasping 
Aggeliki Tsoli and Odest Chadwicke Jenkins 


11:55-12:20 


Dexterous Grasping via Eigengrasps: A Low-dimensional 

Approach to a High-complexity Problem 

Matei Ciocarlie, Corey Goldfeder, and Peter Allen 


12:20-12:30 


Discussion on low-dimensional control 
Topics may include: 

1 . How can sensing and low-dimensional control complement one 
another? 

2. What real-world manipulation tasks could be performed with 
low-dimensional control? 

3. Are there inherently complex manipulation tasks? 

4. How should task complexity be characterized? 






12:30-2:00 


Lunch 






2:00-2:05 


Welcome back and introduction 


2:05-2:35 


Keynote: Andrew Ng 


2:35-3:30 


Poster and demo session #2 
(refreshments from 2:45-3:00) 

1 . Learning Behavior-Grounded Tool Affordances with 
Generalization Across Different Tools 

Jivko Sinapov and Alexander Stoytchev 

2. A New Mobile Manipulation Platform for Automatic Coffee 
Retrieval 

Cressel Anderson, Ben Axelrod, J. Philip Case, Jaeil Choi, 
Martin Engel, Gaurav Gupta, Florian Hecht, John 
Hutchison, Niyant Krishnamurthi, Jin Han Lee, Hal Dai 
Nguyen, Richard Roberts, John G. Rogers, and Alexander 
J. B. Trevor 

3. Learning Robot Soccer from Demonstration: Ball Grasping 
Daniel H. Grollman and Odest Chadwicke Jenkins 

4. Hierarchical Integration of Local 3D Features for 
Probabilistic Pose Recovery 

Renaud Detry and Justus Plater 

5. Approaching Asimov's 1st Law II: The Impact of the 
Robot's Weight Class (video) 

Sami Haddadin, Alin Albu-Schaffer, Michael Strohmayr, 
and Gerd Hirzinger 



Demo: Two Safety Solutions Specific to Service 

IVIanipulators 

William Townsend 

Demo: Precise Target Localization in a Changing Pick & 

Place Environment 

Tino Perucchi and Hansruedi Fruh 

Demo: The Shadow Hand 

Armando De La Rosa 



Visual 
Sensinc 



4:45-5:00 



The Future 



5:00-5:12 
(flexible) 



5:12-5:40 



A Framework for Door Localization and Door Opening Using a 

Computer Controlled Wheelchair for People Living with Mobility 

Impairments 

Alexander Andreopoulos and John K. Tsotsos 

Extracting Planar Kinematic Models Using Interactive Perception 

Dov Katz and Oliver Brock 



Haptically Guided Teleoperation for Learning Manipulation Tasks 
Ayanna M. Howard and Chung Hyuk Park 
Discussion on visual sensing 
Topics may include: 

1 . In what ways is vision for manipulation a distinct area of 
research relative to areas emphasized by the computer vision 
community? 

2. What are the main challenges in visual sensing for 
manipulation? 

3. What are the advantages and disadvantages with respect to 
other forms of sensing? 

4. For what applications is this modality best suited? 

5. How can human-robot interaction (HRI) best support 
autonomous robo ts that sense and adapt to the real world? 

Lightning talks 

(short talks <= 4 minutes each, sign up during the day, time 

allotted will depend on demand and review by the organizers) 

Discussion of future real-world applications of autonomous 

manipulation. 

Goals include: 

1 . Create a list of promising applications. 

2. Identify technical challenges impeding these applications. 

3. Create a list of milestones for research in order to enable these 
applications. 

Planning Session for Next Year 



